4 /to  /93(  7  3 /-/»/« 


OSSIFICATION  -JF  THIS  PAGE 


« 


ao»ianiaiim«iHBHMa 


USARO  D 


11  LE  (and  S'^titlo) 

ON  THE  LIMIT  BEHAVIOR  OF  A  MULT I -COMPARTMENT 
STORAGE  MODEL  WITH  AN  UNDERLYING  MARKOV  CHAIN 
•  WITH  NORMALIZATION 


Eric  S.  Tollar 


PERFORMING  DPKAUl/flTIOi 

Tlie  Florida  State  University 
Department  of  Statistics 
Tallahassee.  FL  32306-3033 


till  *S  C  A 1  A  LOG  UU'lRh 


6.  PERFORM [00  ORG.  RFP! 


8.  O'h'fwncr  MR  'WAMT  U!hSER(s 
USARO  No.  DAAG  29-82-K-0168 


"IRK  IJ'-'IT  rlUMRERS 


•'!!.)«  If  OR  It!!'.  AGENCY  NATE  V-  AOI V  ESS  (if 

different  fron  Controlling  •Office) 


OISikISIIT un  SlAlE'iMlT  (of  this  report 


MM-M-.i?  0 


IS.  SECURITY  CLASS,  (of  this  report' 


iiECLASsIF  IC.AT  IOU/iji}'  IHGRADlU'j 
SCHEDULE 


approved  for  public  release;  distribution  unlimited 


UiS'lNIHUTM'  STaWEHT  (of  t.h*>  abstract  in  Plo ck  ?'),  if  different,  front  report 


NOV  2  1  1985 


"OPUS 

Storage  model,  Markov  chain,  Dual  Markov  chain,  Auxilliary  Markov  chain 
Multivariate  Brownian  Motion. 


T'T  (Continue  on  reverse  side  it'  necessary  and  identify  by  block  number 

paper  considers  a  multi -compartment  storage  model  with  one  way 
flow.  The  inputs  and  outputs  for  each  compartment  are  controlled  by  a  denumer¬ 
able  state  Markov  chain.  Assuming  finite  first  and  second  mom/nt  conditions, 
the  limit  behavior  of  tne  compartments  are  examined.  It  is  shown  that  the 
diverging  compartments  under  suitable  normalization  converge  to  functionals  of  /)>  i 


Brownian  motion,  independent  of  those  compartments  which  converge  without 

, .  ...  ,  ■-  ,  'll  ^  Hi  uh  Uf 

normalization.  ..'  ..-r  .  .  •  -  /V’<  " 

DTK  £ilE  CORY 

8S  U  19  OSfi 


ft  do  /  936?.  3 /./>,# 


ON  THE  LIMIT  BEHAVIOR  OF  A  MULT I -COMPARTMENT  STORAGE  MODEL 
WITH  AN  UNDERLYING  MARKOV  CHAIN  II:  WITH  NORMALIZATION 

by 

Eric  S.  Tollar 


FSU  Statistics  Report  M694 
USARO  Technical  Report  No.  D-77 


February,  1985 


r> 

i  •  i 

i 


The  Florida  State  University 
Department  of  Statistics 
Tallahassee,  Florida  32306 


Research  supported  by  the  U.S.  Array  Research  Office  under  Grant 
DAAG  29-82-K-0168. 


Keywords:  Storage  model,  Markov  chain.  Dual  Markov  chain,  Auxilliary 
Markov  Chain,  Multivariate  Brownian  Motion. 


AMS  (1980)  Subject  classifications.  Primary  60G99 


On  the  Limit  Behavior  of  a  Multi-Compartment  Storage  Model 
With  an  Underlying  Markov  Chain  II:  With  Normalization 

by 

Eric  S.  Tollar 

Abstract 

The  present  paper  considers  a  multi-compartment  storage  model  with  one  way 
flow.  The  inputs  and  outputs  for  each  compartment  are  controlled  by  a  denumer¬ 
able  state  Markov  chain.  Assuming  finite  first  and  second  moment  conditions, 
the  limit  behavior  of  the  compartments  are  examined.  It  is  shown  that  the 
diverging  compartments  under  suitable  normalization  converge  to  functionals  of 
Brownian  motion,  independent  of  those  compartments  which  converge  without 
normalization. 


1.  INTRODUCTION 


In  this  paper,  a  multi -compartment  storage  model  with  one-way  flow  is 
considered.  This  model  is  a  generalization  of  a  one  compartment  model  considered 
by  Puri  [8],  Puri  and  Senturia  [9],  CIO],  Balagopal  [13,  Puri  and  Woolford  [11], 
and  others.  In  Tollar  [12],  it  was  established  that  under  first  moment  criteria, 
as  time  increases,  the  subcritical  compartments  converge  in  distribution, 
while  the  critical  and  supercritical  compartments  diverge.  This  paper  examines 
the  limit  behavior  of  the  divergent  compartments  when  suitably  normalized. 

In  section  2,  the  model  being  considered  is  described,  and  some  results  in 
[12]  are  summarized.  In  section  3,  intermediate  results  for  maximums  of  pro¬ 
cesses  defined  on  a  Markov  are  obtained.  In  particular,  these  results  show 
that  the  normalized  difference  between  the  process  considered  and  the  similar 
maximum  defined  on  i.i.d.  random  variables  converges  in  probability  to  zero. 

In  section  4,  it  is  shown  that  the  divergent  compartments  appropriately  normal¬ 
ized  converge  to  functionals  of  Brownian  motion  and  that  this  behavior  is 
independent  of  the  convergent  compartments. 

2.  THE  MODEL 

Let  (Xn;  n =  0,  1,  2 ,  . . .  }  be  an  aperiodic,  recurrent,  irreducible,  Markov 
chain  with  denumerable  state  space  J  and  stationary  measure  ir  .  For  i  e  J, 

let  {V  (i)  *  (Vn  (i) . V.  (i))  :  n=  1,  2,  ...)  be  a  sequence  of  i.i.d. 

k+1-  tuples,  independent  of  {X^}  and  of  for  j*i.  We  then  consider 

a  model  in  which  Z(n)  «  (Zj(n),  ...»  Z^fn))  represents  the  amount  of  material  at 
time  n  in  the  k  compartments.  For  each  compartment  t,  Z^( n)  is  given  by 
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Z£(n)  =  min  CS^jj)  +  (S^)  -  SjCjj))  ♦  . . . 

0  ^  j  j  ^  i  •  •  ^  3^  j  ^  n 


♦  (SM^  -  S£- i«£.i))3 


(2.1) 


-min  CS0(j.)  ♦  ...  +  (S.(n) -S»(j£))] 


where  S^(m)  is  defined  by 

SiO»)  =  I  V  (X.).  (2.2) 

1  j  =  1  J 

For  further  discussion  of  the  motivation  and  origin  of  (2.1),  see  Tollar  [12]  . 
For  OSisk,  we  define  by 

Vi'  '2-3> 

We  will  refer  to  compartment  l  as  either  subcritical,  critical  or  supercritical 
when  E1TV£ "  o is  Sreater  than*  equal  to,  or  less  than  0,  respec¬ 
tively.  It  is  established  in  [12]  that  as  n  tends  to  infinity,  the  subcritical 
compartments  converge,  while  the  critical  and  super  critical  compartments 
diverge . 

The  convergence  properties  of  the  compartments  were  shown  to  not  depend 
on  the  initial  distributions  of  the  compartments.  Further,  for  {5^:  n*0,l,... 
the  dual  Markov  chain  (for  definition,  see  Cinlar  [4]),  it  was  shown  the  limit 
behavior  of  £(n)  coincides  with  the  behavior  of  Z(n)  =  (2j(n),  ...,  Z^Cn)), 
where  Z^(n)  is  defined  as  follows: 
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ZiCn)  = 


nun 

0*  ...  s  j.  ^sn 


(Si.1(ji)+CSi_2(j2)-Si.2(ji)3+...+[So(n)-S0(ji_1)3) 

(2.4) 


min  (S.(j1)  +  ...  +  [S(J(n)-S  (ji)]) 

05j15...5ji5n 


where  §j(m)  is  defined  as 


S.(m)  =  ?  V  ,(«.). 

J  MJ'4  4 


(2.5) 


It  was  also  established  in  [12],  that  the  initial  distribution  of  XQ  was  not 
related  to  the  limit  behavior  of  the  compartments.  As  such,  we  will  set 
Z(0)  =0,  and  Xg  s  jr,  and  use  either  expression  (2.1)  or  (2.4),  whichever  proves 
more  useful. 


3.  INTERMEDIATE  ASYMPTOTIC  RESULTS 

When  working  with  processes  with  underlying  Markov  chains,  the  typical 
approach  (see  Chung  [3])  is  to  use  the  return  times  to  an  arbitrary  state 
iQ  c  J  to  generate  a  sequence  of  i.i.d.  random  variables.  It  is  shown  that 
functionals  of  these  i.i.d.  random  variables  have  the  same  asymptotic 
behavior  as  the  processes  under  consideration.  This  is  the  technique  to  be 
used  on  certain  functionals  related  to  the  process  £(n)  in  this  section. 

For  arbitrary  iQ  e  J,  we  define  tn(iQ)  recursively  by 

W  =  min(i>tn-i(io):  VV’  W50, 

Let  (Yn(i),  n=l,2,  ...}  be  i.i.d.  sequences  defined  for  all  i  e  J,  independent 
of  (Yn(j)  ,  n»l,2,  ...}  i  *  j ,  and  also  of  .  If  E^.  |  Y  |  <  «,  it  can  be 


shown  (see  Balagopal  Cl])  that 


w 

^Si-^V  +  1 


(3.2) 


is  an  i.i.d.  sequence  with  E[Y*(iQ)  -  (tn(iQ)  -  tn  l(i0))EnY)  =  0,  for  n  >  1. 

If  we  let  o|  =  ECYJ(Iq)2 | Xq  =  ig],  we  have  o?  <  ®  if  and  only  if  o?  <  ®  for 


all  j  e  J,  in  which  case  n.a?  =  ir.  o?  . 

3  3  0  *0 


We  will  also  define 


w 

vv  ■ , L  ... .  AM 


(3.3) 


i'Vl'V*1 


In  most  cases  the  state  ig  is  understood,  and  ig  will  be  dropped  in  expres¬ 
sion  (3.1)  ,  (3.2)  ,  and  (3.3)  .  Let  { (Y^  n(i)  ,  •  •  •  *  Y£  n(*))  :  n  =  1,  2, . . .  }  be  an 
i.i.d.  £-tuple  sequence,  independent  of  (Yj  n(j)  , . . .  ,Y^  n(j))  •  n»l,2,  ...}, 
i  *  j,  and  also  of  (Xn>,  the  Markov  chain  with  stationary  measure  £.  Further, 

let  us  define  M.  (n)  by 
0 


M4  (n)  *  I  I(X.-i0)  . 
‘0  i  =  1  1 


(3.4) 


We  then  have  the  following  intermediate  theorem. 


THEOREM  3.1:  Let  E^l  Yj^l  <  ®,  aid  E(7^ )  xq  =  iQ)  <  »  ,  i  s  i  s  £  .  Then  as 


n  -*•  • 


t  ^k 

n‘l/2[  max  ill  \  *(X.)) 

OsjjS. .  .sj^sn  k=l  i=jkl*l  * 

l  jk 


max  ([  I  YJ.)] 

(1s...sj^sMi  (n)  k»l  i*jkl+l  ’ 


(3.5) 


PROOF.  It  can  easily  be  seen  that 

l  3k 


I  max  (II  Y.  i(xj)) 

Osj1s...sj^sn  k=l  i=3k_i+1  ** 


3l  l  h 

max  Cl  Y  (X.)t  I  I  Y  (X  ))| 

txs  (n-j  1=tj+l  *  k=2  i»jk-1+i 


0 


e  *1  In 

*  I  I  I  Y.  i(Xi)  l  ♦  I  I  |Y  .(X  )|  . 

’-1  i-1  i-tM.  (n) +  1  Jl 

xo 

L  ^1 

Since  P(t1  <«)  =  1,  we  have  that  n ~^2  \  \  |Y.  .(X.)  |  5  0  . 

1  j  =  1  i  =  1  J*1  1 


In  (Chung  [3]),  it  is  shown  under  the  assumption  that  |  Y^.  |  <»,  that 


n"1/2  I  |Y,.(X  )|5o. 

i  *  tw  !  1>X  1 


n 


M.  (n) 


Thus,  we  get  from  (3.5)  that 


n”^2|  max 


l  3k 


C  I  I  \  iCx.j) 

OSjjS.,.5  j^Sn  k=l  i  =  1+* 


l  h 


max 


tjS  jxs  ...  s  tM 


<■1  /i.i'V'L  I.  A,i'V)lEo- 

)  X=t1+1  k=2  i=3k_1+l 


(3.6) 


Let  us  define  t 


=  tM  M  *  l,  rn  =  1 ,  and  for  lsr]sr2s...Sr;sM.  (n) 


M.  (n)  +  1  '  ‘'M.  (n)  **  *0 


lt*m  i. 
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B(Tj  ,  ^2  »  •  •  • »  )  =  ((32»**»»3£)*  j  j  5  32  5  * •  •  s  3^  ’ 


tr1Sil<tr1+l*  tr2SJ2<tr2*l»  ’  * '  ’  Ve"  ^  <  ^+1  }  ’ 

£-  1  jk 

U(rlf  . . . ,  r^)  =  max  ti  l 


(3.7) 


max  LIZ  CYk  iCX.) 

(jj,  ...»  j^)  «  B(r1§  ....  r^)  k=l  i»tr  +1  »x 


h 


(3.8) 


-  W(V>  +  ±Xt  +1Y*,i<V] 


Then  we  have 


3j  £  3r 

I  max  (I  Y  (X  )  *  l  l  Y  (X 

,x  k-2i-ik.1*i 


(X±)) 


Z  rk 


max 

lsr^  ...  ^n) 


(I  I  Yki(Xi))| 

<M,  (n)  k=  1  i  =  t_  +1  K,X 


k-1 


s  max  (U(r.,...,rJ) 

lsr.  s  ...  <r»SM.  (n) 
i  iQ 


(3.9) 


Z-  1 


V 


I  max  (  I  lYk  i(V  ’Yk+1  i(Xi)! 

*1  1  £  j  <  M.  (n)  i*t.+  l  k*1  1  k+1»x  1 

1  1 


Since  we  have 


P(  max  (  l  |Y»  -  (X. )  | )  >  e^n  ) 

1  s  j  <  M.  (n)  i  =  t.+l  1 

H  *  1 

n  *  j+1 

*  P(  u  {  l  |Y»  -  (X.)  i  >  ev^T }  )  (3.10) 

j  =  l  i  =  t.*l 


snP(  [  I  Y»  .(X.)|  >  e^T), 

i  *  tj+1  1 


and  E(Y^  jjXgS  iQ)  <  <*>,  we  get  that 


lim  nP(  J  |  Y»  .  (X.)  |  >  c/K)  •  0 
n->«  i  =  t,+l  ‘L*  1 


(3.12) 


with  a  similar  result  for  the  other  term  in  (3.9).  Thus  we  get 


n‘1/2r 


l  Jk 

max  (  T  J"  Y..(X.)) 

OS  ...  s  j£Sn  k=l  i  =  jk_1*l  k>1 


(3.13) 


l  rk 


max  (II  Y.  .(X-))]  -*•  0. 

isr,  s  ...  Sr.iM.  (n)  k  =  1  i  =  t_  . ,  * 


La  -  W. 

t  x( 


Vl*1 


and  the  theorem  is  established.  0 

Before  continuing  with  results  on  the  maximums  of  sequences  defined  on 
Markov  chains,  we  establish  the  following  lemma  about  i.i.d.  random  variables 
with  finite  variance  and  means  less  than  zero. 
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LEMMA  3.2:  Let  {X  :  n=l,  2,  ...}  be  an  i.i.d.  sequence  with  EX  <  0, 

n  _ 

EX2  <  °° .  Then,  as  n  -*■<», 


n’*^  max  (  S  X.)  5  0  . 
Os  j  sk  Sn  i  =  j  +  1  1 


PROOF.  Set  S 


=  5  X-  , 


*  i  =  1 


max 


Cl  X)  = 

•  •  .  i  * 


max 


0  s  j  s  k  s  n  i  =>  j  +  1  Osjsksn 


<W* 


For  any  m,  divide  [0,n]  into  Cmv^T+1]  approximately  equal  sized  parts,  setting 
n^  =  [i*^  m”1]  with  nj-myr^  +  ij*n«  whe1,6  Cx]  is  the  greatest  integer  of  x.  Then 
let 

i^  =  min{i:  and  (3.14) 


R  =  max  [max(0,  max  (S  -S  .))] 

n’m  OSjSn  i.Sl-srm^T  +  l]  nk  J 

3 


(3.15) 


Clearly,  for  all  n,m. 


R 


n 


a  R 


n,ra 


(3.16) 


To  establish  that  as  n.m^®  ,  n_1^(R  -  R  J  5  0  we  define 

n  n,m 

k 

E.  „  =  (u:  n  [  max  (S»  -  S.)  s  ei^ ]  , 
k*n  £  =  1  05  j  <Z  *  3 


(3.17) 

max  (S.  -  S .)  >  ev^T  ) , 

05  j  5  k  K  3 


( 


E.  i  = 
k,n,l 


n  (to: 


Sk  >  -ev^/2 


t,n,2 


(3.18) 


E, 


=  E.  _  n  (oj :  S. 


-  <  -e/n/2 
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From  (3.17)  and  (3.18)  it  can  be  seen  that 


P(R„  >  v/n  )  .  fc|iPCEk  nJ  .  jHEkiIlil)  *  J***,.,*) 


Also,  from  (3.15)  we  have 


Thus,  we  have 


P(EV  n  ,)  s  P(E.  .  max  (S  -  S.)  >  e/n/2  ) 
K,n,l  K,n  Q^isk  n  J 


*  pCEv  R  >  )• 

k,n*  n,m 


5  PCRn.n,  >  > 


Since  S  -  S,  is  independent  of  E.  ,  we  have 
n .  K  k  ,n 


p<Ek,„,2>  *  p<Ek,n>  p<sn.  -Sk  ' 


Since  the  X's  are  i.i.d.  we  get 


P(Sn  -  Sk  <  -E4T/2  )  =  P(Sn  <  -e/n/2  ) 
*k  ik 

Vk 

=  P(  l  (X.  -EX)  <  -e/n/2  -  (n.  -k)EX) 
i  =*  1  1  xk 


_  .1 

As  can  be  easily  established,  n.  -  k  s  /n  m  +1.  Since  EX<0, 

l, 

k 


Vk 


P(S  -  Sk  <  -e/n/2  )  <  P(  £  (X.  -  EX)  <  -/n  (e/2  ♦  (m”1  +  n' 

ni,.  i  =  1  1 


(3.19) 


(3.20) 

(3.21) 


(3.22) 


(3.23) 


(3.24) 
1/2)EX)))  . 
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i  -1/2 

For  any  e,  choose  m  and  n  sufficiently  large  so  that  e/2  ♦  (m  +  n  '  )EX  >  0. 


Then  from  Chebyshev's  inequality,  we  get 


P(S.  -S.  <-e/n/2)<  (n.  -k)o2n  1(e/2+(m  1  +n  1/2)EX)  2 
"i  K  \ 

k  K  I 

£  ♦  l)o2  n”*(e/2  +  (m-*  +  n~*^2)EX)  2  , 


(3.25) 


Therefore 


I  ^h.n.2)  S  ■  *  D’2®  («/2  *  (»“  *■>' 

<  C^m'1*  l)o2n*1(e/2  ♦  (m_1  *  n'l/2)EX)  “2 


1  . „~1/2%cy\ 


(3.26) 


Thus,  for  all  in  >  -2EX/e,  as  n  +  «  , 


lira  1  P(E.  ,)  «  0. 
n-*-®  k=l 


(3.27) 


Combining  (3.16),  (3.19),  (3.21)  and  (3.27),  we  have  for  m  >  -2EX/e,  there  is 
an  N  where  for  all  n  >  N, 

P(R  >  e/n)  £  P(R  >  e/n)  <  P(R  >e/n/2  )  +  e  (3.28) 

iiu  ii  n  |iu  « 


Clearly,  from  (3.15)  we  have 


R  „  o  max  (  max  (S_  -S.)) 

n,m  lsks  [m^T+  1]  os  j  k  3 


(3.29) 
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Thus, 


[m»/n  + 1] 


P(Rh  m  >  S  I  P(  max  (S -  S. 

k  =  1  Osj^Hc  3 


(S_  -  S.)  >  6^T) 


Cmv'n  ♦  ’  ) 

=  ji  P(  max  (S.)>S*/n), 
k=l  0Sj£nk  3 


since  max  (S  -  S.)  =  max  (S,).  As  such, 
k  3  0^jSnk  3 


(3.30) 


P(R  >  fi/n  )  4  lm/n  +  1)  P(  sup  (S.)  >  6/n) 
n,m  j20  j 


(3.31) 


By  (Kiefer  and  Wolfowitz  [7]),  since  EX  <  ®,  we  have  E  sup  (S.)  <  ®.  Thus, 

j  ;>  0  3 

by  the  well  known  result,  lim  xP(X>x)*0  if  EX+ <  ®,  we  get 

x->  “> 

lim  Cm^T*  1]  P(  sup  (S.)  >  6^n  )  *  0,  for  all  6  .  Thus,  we  have  P(Rn  m>  e/n  )+0, 
j  2: 0  3  * 


n  -*■  «> 


which  yields  from  (3.28)  P(R  >  e/n  )  0  . 


n 


□ 


In  the  following  theorem,  define  (£^,  ...»  ^m)  as  the  indices  of 

E  Y. ,  . . . ,  E  Y»  such  that  E  Y.  =  0. 

TT  1  I  t  IT  •£.  j 


THEOREM  3.3;  Let  j  Y±  |  <®,  s  0,  and  ECY?  J  XQ  =  iQ)  <«  ,  1  S  i  <.  I 
Then,  as  n  +  », 


t  3k 

n'1/2C  max  (II  \  ,(X.)) 

Osj^.^sj^sn  k=l  i=jk_j+l  * 


max 


OsjjS  ...sj^s  [tt^  n]  k=l  i=jkl 


m  ^k  _ 

a  l  n  i>] E  «• 

k=l  i*j,  ,*1  V 
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PROOF :  From  Theorem  3.1,  we  know  that  we  need  only  show  that 

n'1/2[  max  (II  Y*  .) 

Os  ...  s  j£^Mi  (n)  k=l  i=jkl+l  * 


m  -^k  _ 

max  (II  Y$  )]  5  0. 

0  s  j  s  . . .  s  j  s  [ir^  n]  k=l  i=jk  l+l  ,ck*1 


(3.32) 


Since  n  M.  (n)  -►  it.  ,  there  is  a  decreasing  sequence  (e  :  n»l,2,  ,..) 
0  x0  n 


where  e  +0  and  for  all  n, 
n  ' 


P(C0ri  -  On]  S  M.  (n)  s  C(ir.  +  e  )n])  >  1  -  e  . 
x0  0  *0 


(3.33) 


Let  us  define  £.(n)  »  C(ir.  -On],  £(n)  =  Cn4  n],  IA n)  =  [(ir.  ♦  e  )n] 

4  lo  “  xo  c  x0  n 

Then,  for  any  e  >  0, 

i  h 

p(l  max  (II  Y*  ) 

1* (n)  k=l  i*jk  l+l  k'x 

l  jk 

max  (II  Y*  .)|  >  e/n  ) 

1  s  jj  s  . . .  s  £(n)  k=l  iajk_1+l 


1  s  s  . . .  s  ^2(n) 


l  jk 

(II  Y*  ,) 

)  k=l  i=jk_1  k’i 

i  h 


max  (II  Y*  )  >  e^T)+  e 

is  jxs  ...  s  j£s£1(n)  k=l  i-jkl  K’1  n 

h 

s  P(  max  (  l  Y* 

^(n)s  jjS...  sj^s£2(n)  i=£j(n)+l  1,1 

l  h 

*  I  I  Y*  )  >  i/Z  )  ♦  en  . 

k-2  i-1,_  ,♦!  k'i  n 


C3.34) 


(3.35) 


Because  the  Y t  . 's  are  i.i.d,  we  have 

■C,  1 


ji  ^  3^ 

max  (  l  **  4  +  X  X  i 

j2s£2(n)  i^Cn)*!  k=2  i-j^l  ^ 


) 


max 


Os  ^s  ...  -£j(n) 

Now,  we  have 


h~l  i  ik_1 
(I  Y1  i +  I  I  ^.). 

i=0  A’x  k=2  .  K>1 


k-1 


hml 

m 

V1 

max 

( X 

Y£  i 

♦  X 

X 

0  5  j  j  5 

S  •••*3m*£2(n)  ‘ 

-  £x(n) 

i=0 

V1 

k=2 

is3k 

V1 

£ 

V1 

s 

max 

(  X 

Yl  i  + 

X 

X 

OS  jj2 

i  . . .  s  j^s  -^(n)  ■ 

■£l(n) 

i=0 

1,1 

k=2 

i=jk-3 

V1 

m 

V1 

< 

max 

c  X 

Y£  t 

♦  X 

X 

OS 

•  £x(n) 

i=0 

k=2 

iah- 

m  ^k"1 

J  X  C  max 
k*l  j-4k_1+l  osrsss  Z2(  n)  -  l^n) 


s-1 


£  s-1 

X  max  (  I  Yj* 

k=£m+l  0  s  r  s  s  s  £2(11)  -  £j(n)  i=r  K’ 


Since  E(Yt  ^  -  Y|^  .)  <  0  for  ^  <  j  <  we  have  from  lemma  3. 


2  that 


-1/2 

n  max 


OSrSss £2(n)  "  £j(n) 


(3.36) 


(3.37) 


and  similarly 


-1/2 

n  max 

Osrsss  (n) 


s-1 


(  I  Y*  )  $  0  for  j>£.  . 
i=r  3 ’ 1  k 


In  addition,  since 


max 

Os  j  s  ...  s  j 


Jt1 


m  •’k 


3v-i 


m 


(  I  YJ  i+  I  Z  ■  V*  .) 
s£2(n)  -£j(n)  i=0  V1  k=2  V1 


(3.38) 


_  .  r.-l 
m-1  i 


r  -1 
m 


max  c  I  I  (*5  ,  -  Y«  .)  +  y  YS  .) 

Osr^  ...  s^s^fn)  -^(n)  j=*l  i=0  V  V*'  i^oV1 


we  get 


a  V1 


P(  max  (  l  Y*  .  ♦  l  l  Yt  .)  >  cfr  ) 

OSTjS  ...  srnsyn)  --^(n)  i=0  V1  k=2i=rkl  4*1 

m;1  r-1 

-  1  p(  max  (  I  YJ  4  “ Y)  4)  >  e’/a/n  ) 

j=l  Osrsyn) -^(n)  i=0  j’  j+l’1 


(3.39) 


+  P(  max 

Osrs^n)  -£j(n) 


r-1 


(  I  j)  >  e/n/ra  ) . 
i=0  m' 


For  is  j  <m,  we  have  E(YS  .  -  YS  .)  =  0,  and 

j’1  j+l’1 

r-1  1/2 

P(  max  (  I  (Y?  .  -  YS  ))  >  J  - - - - 1/2 

Osrs^(n) -t  x(n)  i=0  j’  *>!'  ®  (*  (n)  -  £  (n))1'* 


(3.40) 

(*2(n)-£1(n)jl/ 


r-1 

p<  o  (  I  (YS  .-Yt  J)  >  |  (2e  ♦n“1)‘1/2  (^(n) -^(n))172). 

0srs£2(n)-ij(n)  i=0  j*1  j+l»l  m  n  *  1 


Thus,  since 


r-1 

max  (  ]>  Y?  .  -  Y3  . )  converges  to  an  absolute  normal , 
OSrSn  i=0  j ,1  j+l*1 


-1  -1/2 

(see  Erdds  and  Kac  [6]) ,  we  have  that  since  (2en  ♦  n  )  that 

expression  (3.40)  converges  to  0,  regardless  of  whether  or  not  L^ti)  -  £j(n) 
tends  to  infinity.  As  such,  from  (3.34),  (3.36),  (3.37)  and  (3.39),  we 
have  that 


n_1/,2[  max  ([  [  Y.  -(X.) 

Osj1s...sj£snkSl  i=ik  l+l  K>1  x 

l  V1 

max  (I  l  VJi)]  +  0. 

l^r^s  ...sr^s  n]  k=l  i=rkl  * 


(3.41) 


Finally,  note  that  if  ^(n)  --£|(n)  is  replaced  by  n  in  (3.36),  (3.37),  we 
get  that 


l  V1 

n”1/2[  max  (  l  l  Y*  ) 

0  5  rj  s  . . .  s  r^s  Drr^  n]  k=l  i=rkl  * 

■  v1 

"■a*  (II  V*  ,)]  ,  4 

Osr.  s  ...  Sr  s  [it.  n]  k=l  i*r.  ,  k* 

1  m  1q  k-1 


0  . 


which  coupled  with  (3.41)  completes  the  proof  of  the  lemma.  □ 


In  the  following  section,  the  limit  behavior  of  the  critical  and  super¬ 
critical  compartments  is  established. 


4.  THE  ASYMPTOTIC  BEHAVIOR  OF  THE  NORMALIZED  PROCESS 


The  behavior  of  the  normalized  critical  and  supercritical  compartments 
can  now  be  established.  In  addition,  it  will  be  shown  that  the  limit  distri¬ 
bution  of  the  normalized  compartments  is  independent  of  the  limit  distribution 


of  the  subcritical  compartments.  The  lemma  needed  to  establish  the  asymptotic 
independence  of  the  subcritical  and  the  critical  and  supercritical  compartments 
will  be  stated  without  proof,  since  it  is  straightforward. 


LEMMA,  4.1  Let  {(Xj(n) ,  X2^n^  »  n  3  2,  .  •  • )  be  a  sequence  of  random  vector 

couplets  defined  on  a  Markov  chain  {X^}.  Let  Y^Cn)  5  Y^as  n  ».  Further, 

for  all  m  >  0,  let  there  exist  a  random  vector  sequence  {Y^m^ »  n  =  m,  m+1,  ...} 

defined  on  the  chain  {X_}  such  that 
*— ■  ■-  n  — . — . . 

1)  ^  n  <*»  for  all  m  >  0. 

2)  PCX^m)  s  x,  Y^m)  s  X|Xffl)  =  PCXjCm)  s  x|Xm)P(Y^m)  5  X\xj ,  for  n  *  m, 

3)  P^m)  s  ^  **■  P(X2  £”  +  »,  for  all  i  e  J,  for  all  m,  for  all 

continuity  points  yof  L.  Then,  for  all  continuity  points  Qs.y)  of  the 
distribution  (Yj.Y^)  ,  we  have 

lim  PCX^n)**,  Y2(n)Sy)  =  PCY^jc)  PCY^jr). 


We  now  establish  the  main  theorem  of  this  paper.  In  the  k  compartment 
model,  let  (ij,  ...,  im)  be  the  indices  for  the  subcritical  compartments ,  and 
let  (jj,...,  j^)  be  the  indices  for  the  critical  or  supercritical  compartments, 
so  m  +  f.=*k.  Further,  for  ease  of  notation  we  define  for  l£i£k,  by 


ui  3 


mm 

0  s  j  <  i 


<E„V  -  E„vi 


(4.1) 


Then  the  following  theorem  holds. 
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THEOREM  4.2  If  Ejvj  <»,  E[V?  x  |  XQ  =  iQ)  <  »  for  0  S  i  5  k ,  then 

lim  P(Z.  (n)ix.  (n)£x.  ,  Z.  (n)-ny.  sx.  n1^2, 

n-*-»  1  1  m  m  J1  31  31 


. ...  Z.  (n)  -ny.  Sx.  n1/2) 

H  H  H 


=  P(Z.  £  x.  .....  Z.  S  x.  )  •  F(W0(.)  .....  Wk(0) 
11mm 

for  all  continuity  points  (x.  .....  x.  )  of  (Z.  .....  Z.  ),  where 

X1  xm  X1  xm 

WQ(*) .....  W^CO  is  multivariate  Brownian  motion  with  0  drift  and  appropriate 
2 

variance  matrix  a  ,  and  F(»)  is  some  appropriate  functional. 

PROOF.  We  will  first  find  asymptotically  equivalent  expressions  for  the 
critical  or  supercritical  compartments.  Let  compartment  Z  be  either  critical 
or  supercritical.  From  (2.1)  it  can  be  shown  that 

Z£(n)  *  min  CS^jjMS  (J2)-Sx(j ,))+... +(Sw(n) -SWUW))] 

Osjl5...s  jwsn 


-  I  Z . (n)  -  min  CS0(j1)+...  +  (S»(n)-S„(j£))] 

j— w+1  J  Osjxs...sj^sn  ^ 

for  w  defined  as  w  »  max{j  <Z:  E  V.  =  rain  E  V.).  By  (Tollar  [123),  we 

17  3  0£i<l  *  1 

have  that  n_1^2Z.  (n)  5  o,  for  w<i  <Z  .  Thus  we  need  only  consider 
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min  [S0«i)  +  •  •  •  ♦  (Sw(n)  -  Sw(jw)}  ] 


O^j.  s  ...  sj£n 


(4.3) 


w 


*  S  (n)  - 
wv  ' 


min  CSoCjj)  ♦  •  •  •  ♦  (S^(n)  -  S^(j^)) ] 

Osj^s...sj£Sn 

n<,  5<lCccsw(W>-W]-[VW-W])> 

os  j,  s  s  j  sn  m=0 
J1  Jw 

-  V")*  n<.  .  il'wiiW-W'-'V-ii-Wi)). 

0SjjS...5j^sn  m=0 


From  the  definition  of  w  and  the  assumption  that  cell  t  is  either 

critical  or  supercritical,  we  know  that  E  V  -E  V»S0  for  Osm<£,  and 

n  m  ir  -t. 

E^V  -EffVwsO  for  OSn<w.  Also,  it  is  well  known  (see  Chung  [3])  that 


n-1/2CS 


[it.  n] 
0 


yn>  -  iml  v;,i3 1 0  ■ 


(4.4) 


Thus,  from  Theorem  (3.3)  and  (4.3)  we  have 

,-V2 


[tt  n] 
0 


n' '  cz*(n)  ■ 


r  Ijn 

♦  ma*  (II  (V*t-V*  i)} 

0  S  j  j  i  . . .  s  s  [ir^  n]  msl  i=jm  l+l  ’  m’1 

r  ^m 

max  (II  (VS  .  -  V*  .) 

Os  jjS  ...  s  n]  m»l  i-jm  l+l  <c»1  V1 

ir+l 

♦  l  i>H  So* 

lej  +1  't»1  W»1 

JT 

where  (kj,  .  ..jk^  are  the  indices  less  than  w  where  E^ 


(4.5) 


EirVw*  As  such» 
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Cir-  n] 


.-1/2, 


n-*'-[Z£(„)  -nVi-  l  (v;ti  -  V!>i  - 

i=0  U 


r 


max 


<i,  .i.  ,v:,i-vi;,i) 

m=l  i=i  , -1  m* 


0  s  s  . . .  5  jr  s  [tn  n]  m=l 

r  1m 

max  (I  I  (v!  i  -  vk  i> 

0^j1s...sjr+iSCiri  ti]  m-1  i=Vj+l  * 


m’ 


(4.6) 


3 


*  1  (V|  i-v*  .)>]  So. 

i=j  +i 


Note  that  in  (4.6),  if  E  V  >  E  V»  ,  thenfrom  lemma  3.2  it  follows  that 

7T  W  IT  K, 

r  Jm  ir+1  _ 

(II  V|  -V*  ).  I  (V|  -v;  jijSo, 

r.  n]  m=l  i*j_  ,♦!  V1  i»i  +1  ^*x  ,x 


-1/2 

n  '  max 


OsjjS. .  n]  m=l  i*j 


m-1 


(4.7) 


in  which  case,  this  term  can  be  deleted  from  (4.6). 

Thus,  from  (4.6)  we  have  that 
-1/2 

n  C(Z.  (n)  -  ny.  ,  Z .  (n)  -  ny .  ,  . . . ,  Z.  (n)  -  ny.  )] 

J1  J1  J2  h  h 

is  asymptotically  equivalent  to  a  functional  of  (Y.  (•)>  . ..,  Y.  (•)) 

v  y  n  ic  |  n 

where  for  0  s  t  s  1, 


[nir.  t] 


V(t)  ■  " 


.  .-1/2 


I  (VJ  i  -  *i‘  W  . 

i=l  '  xo 


(4.8) 


To  see  this,  one  need  only  note  that 


20 


r  ^m 


max  Cl  I  Vw  i '  Vk 

*  ...  s  [iri  n]  m=l  i=jm  l+l  *  V 


(4.9) 


sup 

05s,5..,$s  5 
1  r 


,tY„,n<V  -  J/WV  ‘  \ ,n(V:»] 

1  ’  m=l  n  m 


with  similar  relations  for  the  other  necessary  terms  of  (4.6).  Thus,  for 
(jj»  J2»  •••»  jf)  the  indices  of  the  critical  or  supercritical  cells,  we  have 

n“1/2((Z  (n)-np.  ,...,Z  (n)-nw.  ))-h(Y  (•),-. .,Y.(0)  ^  0,  (4.10) 

Jl  ^  l£  u,n  K*n 

for  h(*)  an  appropriate  functional  on  (^**[0,1].  That  h(*)  is  continuous  is 
clear  from  (4.6),  so  we  have  by  the  uniform  convergence  of  (Yq  n(l),...Y^  n (1) ) 
to  multivariate  Brownian  motion  (see  Billingsley  [2],  Donsker  fS])  that 


h(Y_  „(•),  •  •  • »  Y.  (•))  $  h(W.(.),  ...,  W.  (•)), 


(4.11) 


where  (WQ(»),  •  ••»wjc(*))  is  a  multivariate  Brownian  motion  with  drift  0  and 


.  2 

variance  matrix  a  given  by 


(o'er)..  =  ir.  cov(V?  ,  ,  Vt  .) 
-1  1q  ->>A 


(4.12) 


To  complete  the  proof,  we  need  only  show  the  asymptotic  independence  of 
the  critical  and  supercritical  cells  from  the  subcritical  ones.  This  can  be 
accomplished  by  appealing  to  Lemma  4.1.  For  (ij,  ...,im)  the  subcritical 
indices,  we  know  from  (Tollar  [12])  that 

(Z.  (n),...,Z.  (n))  aVS*  (Z.  ,...,Z  ).  (4.13) 

11  xm  *1  m 

Also,  for  (jj,  ...,  j^)  the  critical  or  supercritical  cells,  let 
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Z^m)(n)  =  min  (  l  V 

Js  insr^s  ...  sr.  jSn  i=m+l  Js  ' 

^  s 


♦  I  V  2  i  (**)♦••.+  l  V0  (4<14) 

i=r,+l  ^ s  ^jl  1  i=r .  ,+l  U>1  1 


V1 


m 


min  (  l  V  I  VQ  ifX.)) 

Sr,  s,.,Sr.  sn  i=m+l  •'s’  i=r.  ,  ’ 


V1 


To  apply  Lemma  4.1,  let 


li  w 

Y2(n) 


=  (Z.  (n),  Z  (n)), 

1  m 

.  n-V2 


Y 

~n 


(m) 


nLU{t  (n)  -  ny.  ,  ...»  Z  (n)  -  n„.  )) 

31  31  3l  3l 

n'1/2(^n)(n)  .  n  >  .  z(m)(n)  -  ny  )) 

3i  3i  3i  3  a 


Clearly  the  conditions  of  the  lemma  are  met,  which  yields  the  sought  after 
independence.  This  completes  the  proof  of  the  theorem.  □ 

To  highlight  the  nature  of  the  functional  cited  in  Theorem  4.2,  we  will 
state  without  proof  the  marginal  asymptotic  behavior  of  any  critical  or 
supercritical  cell  as  a  corollary  of  Theorem  4.1,  as  it  follows  directly  from 
(4.6)  and  (4.7). 


(kj »  k2 1 


For  a  fixed  l,  let  w  =  max(j  < L:  E  V.  =  min  E  V.},  and 

w  3  Osj<£.Tri 

k_)  be  the  indices  such  that  k,  <  w  and  E  V,.  =  E  V  ..  Then  if 

r  —  — 1  7T  K .  TT  W  1 1 1  “ 

1 


1)  compartment  t  is  supercritical. 


n-1/2(2£(„)  .  n(EiIVw  -  E^)}  i  W  (H  -  W£(l) 


sup  cww(sr)  -  l  (w  (S  )  .  w  (*„.!))): 

...ss.si  m=l  m  m 


0SS.S...SS  <1 
i  r 


or  if  2)  compartment  t  is  critical, 

n-^Vo  -  »uc»-w£a)-  sup  cwu(sp-  nwk  (s  )-wk  (s  rn 

OSs^s. . .Ss^sl  m=l  m  m 

*  ns.s!Up«  s,CV^l)’l(\<S'»)'Wk  CVl»-t*w‘W-W»  • 

uss^s. .  sr+2Sl  m=l  m  m 


where  (W^ (•),  . . . ,  W.  ( • ) )  is  multivariate  Brownian  motion  with  drift  0  and 
o2  given  by  (4.12). 

The  expressions  for  h(* )  given  in  Theorem  4.2  and  Corollary  1  can 
obviously  be  improved  upon  for  the  various  specific  arrangements  of  critical, 
supercritical,  and  subcritical  cells.  Some  of  the  limit  distributions  for 
certain  arrangements  of  critical  and  supercritical  cells  have  densities  that 
can  be  expressed  in  integral  form,  but  it  should  be  noted  that  many  of  the 
limit  distributions  seem  to  not  have  such  simplified  forms.  As  such,  the 
expressions  in  Corollary  1  cannot  be  noticeably  simplified  to  expressions 
that  do  not  use  functionals  of  Brownian  motion. 


5.  CONCLUSION 

There  are  several  directions  of  further  research  left  unanswered  in  this 
paper.  While  the  asymptotic  behavior  of  the  critical  and  supercritical  models 
were  given  in  Corollary  1,  nothing  about  the  limiting  distribution  for  the 


subcritical  cells  other  than  existance  was  specified.  Any  characterization 
of  this  limit,  however,  seems  to  be  extremely  difficult.  For  the  single 
cell  model,  results  were  obtained  by  Puri  T 12 3 ,  but  the  techniques  there  do 
not  seem  to  generalize  to  the  present  case. 

Results  for  more  general  flow  structure  than  the  one-way  flow  used 
in  this  paper  seem  to  require  different  techniques  than  used  above.  Unlike 
the  one-way  flow  model,  there  appears  to  be  no  closed  form  expression  for 
Z^(n)  in  the  more  general  framework. 

The  model  could  be  extended  to  continuous  time  by  considering  an 
underlying  semi-Markov  process  instead  of  a  Markov  chain.  Results  in  this 
area  are  presently  under  preparation. 


V*  .V 
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